Martin Capacity for Markov Chains
نویسندگان
چکیده
The probability that a transient Markov chain, or a Brownian path, will ever visit a given set Λ, is classically estimated using the capacity of Λ with respect to the Green kernel G(x, y). We show that replacing the Green kernel by the Martin kernel G(x, y)/G(0, y) yields improved estimates, which are exact up to a factor of 2. These estimates are applied to random walks on lattices, and also to explain a connection found by R. Lyons between capacity and percolation on trees.
منابع مشابه
Empirical Bayes Estimation in Nonstationary Markov chains
Estimation procedures for nonstationary Markov chains appear to be relatively sparse. This work introduces empirical Bayes estimators for the transition probability matrix of a finite nonstationary Markov chain. The data are assumed to be of a panel study type in which each data set consists of a sequence of observations on N>=2 independent and identically dis...
متن کاملThe Rate of Rényi Entropy for Irreducible Markov Chains
In this paper, we obtain the Rényi entropy rate for irreducible-aperiodic Markov chains with countable state space, using the theory of countable nonnegative matrices. We also obtain the bound for the rate of Rényi entropy of an irreducible Markov chain. Finally, we show that the bound for the Rényi entropy rate is the Shannon entropy rate.
متن کاملEvaluation of First and Second Markov Chains Sensitivity and Specificity as Statistical Approach for Prediction of Sequences of Genes in Virus Double Strand DNA Genomes
Growing amount of information on biological sequences has made application of statistical approaches necessary for modeling and estimation of their functions. In this paper, sensitivity and specificity of the first and second Markov chains for prediction of genes was evaluated using the complete double stranded DNA virus. There were two approaches for prediction of each Markov Model parameter,...
متن کاملMartin Capacity for Markov Chains and Random Walks in Varying Dimensions
Kakutani (1944) discovered that a compact set IR is hit with positive probability by a d-dimensional Brownian motion (d 3) if and only if has positive Newtonian capacity. When capacity criteria were transferred to the discrete setting (by Ito and Mckean (1960) and Lamperti (1963)) it was in the form of a \Wiener Test" (c.f. Corollary 2.4). This kind of summability condition is quite e ective in...
متن کاملTaylor Expansion for the Entropy Rate of Hidden Markov Chains
We study the entropy rate of a hidden Markov process, defined by observing the output of a symmetric channel whose input is a first order Markov process. Although this definition is very simple, obtaining the exact amount of entropy rate in calculation is an open problem. We introduce some probability matrices based on Markov chain's and channel's parameters. Then, we try to obtain an estimate ...
متن کامل